Improving the consensus performance via predictive mechanisms 
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Considering some predictive mechanisms, we show that ultrafast average-consensus can be 
achieved in networks of interconnected agents. More specifically, by predicting the dynamics of 
the network several steps ahead and using this information in the design of the consensus protocol 
of each agent, drastic improvements can be achieved in terms of the speed of consensus convergence, 
without changing the topology of the network. Moreover, using these predictive mechanisms, the 
range of sampling periods leading to consensus convergence is greatly expanded compared with the 
routine consensus protocol. This study provides a mathematical basis for the idea that some predic- 
tive mechanisms exist in widely-spread biological swarms, flocks, and networks. Prom the industrial 
engineering point of view, inclusion of an efficient predictive mechanism allows for a significant 
increase in the speed of consensus convergence and also a reduction of the communication energy 
required to achieve a predefined consensus performance. 

PACS numbers: 05.65. +b, 87.17.Jj, 89.75.-k 



I. INTRODUCTION 

Over the last decade, scientists have been looking for 
some common, possibly universal, features of the collec- 
tive behaviors of animals [l| , bacteria 1, cells (3, molec- 
ular motors j3|, as well as driven granular objects 
The collective motion of a group of autonomous agents 
(or particles) is currently a subject of intensive research 
that has potential applications in biology, physics and 
engineering. One of the most remarkable characteristics 
of complex dynamical systems such as flocks of birds, 
schools of fish, or swarms of locusts, is the emergence 
of a state of collective orders in which the agents move 
in the same direction, i.e. an ordered state [1, 0, 01 ■ 
This ordered state seeking problem can be further gen- 
eralized to a consensus problem [1, where a group 
of self-propelled agents agree upon certain quantities of 
interest such as attitude, position, temperature, volt- 
age, etc. Furthermore, solving consensus problems us- 
ing distributed computational methods has direct impli- 
cations on sensor network data fusion, load balancing, 
swarms/flocks, unmanned air vehicles (UAVs), attitude 
alignment of satellite clusters, congestion control of com- 
munication networks, multi-agent formation control, and 

so on 

Among the most important early works on consensus 
problems, Fiedler showed that the second smallest 
eigenvalue A2, namely the algebraic connectivity, of the 
Laplacian matrix L associated with the graph defining 
the network topology is directly related to the consensus 
speed of the network. It was also shown that a network 
with high algebraic connectivity is robust to both node- 
failures and edge-failures. In Q, Olfati-Saber and Mur- 
ray analyzed consensus problems in networks of agents 
with continuous-time dynamics (basically integrators), 
switching topology and time-delays, and proved that de- 
creasing the largest eigenvalue A at of the Laplacian ma- 



trix L improves the consensus robustness of the net- 
work to time-delays. Consequently, the condition number 
provides a measure of the consensus performance 
of the considered network in the sense that the smaller 
its value, the better the consensus performance (consen- 
sus speed and robustness to time-delays). Moreover, in 
the authors also provided a feasible range of sampling 
rates leading to consensus in the case of discrete-time dy- 
namic networks. In this way, the theoretical foundations 
of general consensus problems were established. To im- 
prove the speed of convergence towards consensus, they 
further proposed a method based on the addition of a 
few long links to a regular lattice, thus transforming it 
into a small- world network [H, In Xiao and 

Boyd transformed the fastest distributed linear averag- 
ing problem into a convex optimization problem by con- 
sidering a particular per-step convergence optimization 
index. Additionally, they proved that, when the network 
topology is symmetric, the problem of finding the fastest 
converging linear iteration can be cast as a semidefinite 
programming problem, and thus can be efficiently and 
globally solved. In [ll|, consensus problems in a hetero- 
geneous infiuence network were investigated by Yang at 
al. and it was shown that, by decreasing the scaling expo- 
nent in the associated power-law distribution, the ability 
of the network to reach direction consensus among its 
agents is significantly enhanced due to the leading roles 
played by a few hub agents. 

In summary, most of the previous works achieved per- 
formance improvements, such as increasing the consensus 
speed, improving the robustness to nodes and edges fail- 
ures, or improving the ability to deal with time-delays, 
solely based on the currently available information fiows 
on the network. In these works, the computing abili- 
ties of an agent of the network is fairly limited: the 
agent can only observe the current behavior (state) of 
its neighbors and update its state according to this ob- 
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FIG. 1: (Color online) Illustration of the predictive nature of 
flocks, swarms and networks. 



servation. However, in natural bio-groups, individuals 
generally possess some higher level of predictive comput- 
ing capabilities that they use for updating their state. 
Experiments revealing the use of prediction mechanisms 
by individuals of a network have been described in the lit- 
erature previously. In particular, as early as 1959, Woods 
[l9| designed some bee swarms experiments and provided 
evidences for the existence of certain predictive mecha- 
nism in bee swarms formation. In 1995, Montague et 
al. proposed simple hebbian learning rules to explain 
the predictive mechanisms used by bees when foraging in 
uncertain environments [23|- Apart from the investiga- 
tion of the predictive mechanisms used during swarming 
and foraging, several researchers focused on the predic- 
tive functions of the optical and acoustical apparatuses 
of individuals inside bio-groups, especially the retina and 
cortex jU, m, [i^l. Based on intensive experiments on 
the bio-eyesight systems, it was found that, when an in- 
dividual observer prepared to eye-follow a displacement 
of the visual stimulus, the visual form of adaptation was 
transferred from the current fixation to the future gaze 
position. These reported investigations support the con- 
jecture of the existence of some predictive mechanisms 
inside many bio-groups. 

In this paper, we show that, by introducing a pre- 
dictive mechanism, it is possible to either significantly 
enhance the consensus speed obtainable under the con- 
straint of a fixed amount of communication energy or to 
decrease the communication energy required to ensure a 
prescribed consensus speed. This observation allows us 
to infer that prediction mechanisms may exist universally 
in many natural bio-groups. A general physical picture 
illustrating this paradigm is given in Fig. 1, which is in- 
terpreted as follows: in widely-spread natural bio-groups 
composed of animals, bacteria, cells, etc., the next-step 
behavioral decision of each individual/particle/agent is 
not only based on the current available state informa- 
tion (position, velocity, etc.) of the other (neighboring) 
agents inside the group, but is also based on their pre- 
dicted future states. More precisely, bearing in mind a 
few past states of its leader and neighbors, an agent can 
estimate their future states several steps ahead and then 



make a decision on its own action. Estimation of these 
future states by each agent can eliminate the require- 
ment of intensive communication among the agents so 
that the overall communication energy of the group can 
be reduced effectively. 

From an industrial appHcation point of view, the phe- 
nomena and mechanisms reported in this paper may be 
applicable in some relevant prevailing engineering areas 
such as autonomous robot formations, sensor networks 
and U AVs [l3, [HI, ■ Each agent in such a group typ- 
ically has limited power to send messages, and thus a 
larger sampling period is generally desirable to save com- 
munication energy. Since using a predictive mechanism 
can sharply expand the range of feasible sampHng peri- 
ods, it should be useful for industrial applications where 
overall communication energy is limited. 

The rest of this paper is organized as follows. In Sec- 
tionini the two main problems addressed in this paper are 
formulated. In Section lllli the all-to-all Hnk model pre- 
dictive control (MFC) average-consensus protocol is pre- 
sented together with its convergence analysis and some 
statistical simulation results. In Section IIV^ the MFC 
consensus protocol is generaHzed to partial link networks. 
Additionally, conditions that guarantee asymptotic con- 
vergence of the proposed protocol are provided, and sim- 
ulation results showing its main characteristics and ad- 
vantages are presented. Finally, conclusions are drawn in 
Section |Vl 



II. PROBLEM DESCRIPTION 

In order to discuss and illustrate the role of predic- 
tion mechanisms in networks of interconnected agents, 
we consider one of the simplest type of networks, i.e. 
networks of linearly interconnected integrators. The in- 
terconnection structure of such networks can typically be 
represented by a directed graph (called digraph for short) . 
In this representation of the network, the N nodes of the 
digraph represent the N agents of the network and a 
weighted edge from node i to node j indicates the ex- 
istence of a communication link from agent i to agent j 
in the network. The digraph is denoted by G = (V, £, A), 
where V = {vi, . . . tVn} is the set of nodes, f C V x V 
is the set of edges, and A is the associated weighted ad- 
jacency matrix, i.e. A = {aij}^^^^ ^ S R^^^, with 
nonnegative elements which are zero when there is no 
communication link from ito j. Furthermore, we assume 
that there is no self-cycle, i.e. aii = 0, V« = 1, . . . , TV. 

Let Xi{t) £ M denote the state of node i, which might 
represent physical quantities such as attitude, position, 
temperature, voltage, etc. To obtain a full representation 
of the dynamic network under consideration, we refer to 
it as Gx = (G, x) where x S denotes the network 
state and G its topology (or information fiow) . Generally, 
we say that the nodes of a network have reached consen- 
sus if and only if Xi = Xj for all i,j € V. Whenever the 
nodes of a network are all in agreement, their common 
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value is called the group decision value. If the group de- 
cision value is x{0) = l/^(X]i!=i the network is 
said to have reached the average-consensus. In the rest 
of the paper, for brevity, we denote average-consensus by 
consensus. 

Agents with continuous-time models are typically de- 
scribed by the integrator dynamics 

x,{t) = u,{t), (1) 

while agents with discrete-time models are described by 
the difference dynamics 

x,{k + l) = xi{k)+eui{k), (2) 

where e denotes the sampling period or step-size. 
Average-consensus is typically asymptotically reached us- 
ing the routine consensus protocol 

N 

Ui{t) = -^aijAxij{t), i,j = l,...,N, (3) 
i=i 

where Axij{t) = Xi{t) — Xj{t) denotes the state dif- 
ference between the and the j"* agents of the net- 
work. It has been proven in Q that, in a network Gx 
with fixed topology and continuous-time dynamics de- 
termined by llj, the routine protocol ^ globally and 
asymptotically solves the consensus problem if and only 
if G is strongly connected and balanced. The assump- 
tion of a strongly connected network amounts to impos- 
ing that any two distinct nodes can be connected via 
a path that follows the direction of the edges of the di- 
graph. The balanced network assumption corresponds to 
^ij — '^ji^ i = 1, . . . , N which is obviously more 
general than the symmetric network condition, in which 
a^j = Qji, i,j^l,...,N. 

Considering the routine protocol ([3]), the dynamics of 
a network of continuous-time integrator agents is defined 
by: 

x{t) = -Lx{t), (4) 

where L = {Uj^ij^i ^ € R^^^ is called the graph 
Laplacian matrix induced by the topology G and is de- 
fined as hi = = and kj = -a^, 
\fi ^ j, where denotes the element of the ad- 
jacency matrix associated with G. By construction, the 
Laplacian matrix has zero row sum, i.e. LI = with 

1 = [1, . . . , l]jvxl- 

For agents with discrete-time dynamics applying 
the discrete-time version of the routine consensus proto- 
col ^ yields the following discrete-time network dynam- 
ics: 

x{k + 1) = Pex{k) (5) 

with Pe ~ In — (see 0). Let c?max = niaxj (la) de- 
note the maximum node out-degree of the digraph G. As 
shown in and [l3|, if the network is strongly connected 



and balanced, and the sampling period e € (0, l/dmax), 
the routine consensus protocol ^ ensures global asymp- 
totic convergence to consensus. 

Some previous works were devoted to accelerating the 
speed of convergence towards consensus (see for example 
[1, [3, [H, [l3|) since high-speed consensus is obviously 
always desirable in engineering practice. On the other 
hand, extension of the consensus feasible range of the 
sampling period e is also important as it typically allows 
for a reduction in the required communication energy and 
may provide an explanation for the fundamental mecha- 
nisms used by bio-groups to exhibit collective behaviors. 
Accordingly, two naturally-motivated problems are ad- 
dressed in this paper: 

• the increase of the average-consensus speed; 

• the extension of the feasible range of the sampling 
period. 

The approach to be taken is based on the introduction 
of some predictive mechanism. 

For simplicity, we assume that all the networks consid- 
ered in the rest of the paper are strongly connected. 

III. MODEL PREDICTIVE CONSENSUS 
PROTOCOL FOR ALL-TO-ALL LINK 
NETWORKS 

In this section, we first introduce an MFC algorithm 
to solve the average-consensus problem for all-to-all link 
networks (or complete graphs in which each pair of ver- 
tices is connected by an edge). We then provide some 
theorems that support this algorithm. Afterwards, we 
give some simulation results to illustrate the feasibility 
and superiority of this MFC consensus algorithm. 

A. Algorithm 

In order to improve the consensus performances, we 
replace the routine control protocol given in ^ by the 
following MFC consensus protocol: 

JV 

"^ii^) = '^O.io^^i.A^) +'"iik), (6) 

where Vi{k) is an additional term representing the MFC 
action, and the state difference Axij{k) = Xi{k) — Xj{k). 
With this MFC protocol, the network dynamics are given 
by 

x{k + 1) = P,x{k) + v{k) (7) 

with v{k) — [vi{k), . . . ,V]y{k)]'^ representing the MFC 
decision values for the N nodes of G. The MFC ele- 
ment v{k) will be calculated by solving the optimization 
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problem associated with a specific moving-horizon opti- 
mization index function (see (fT2|) . for example). 

Using the consensus protocol ([6]), the future network 
state can be predicted based on the current state value 
x{k) as follows: 

x{k + 2) = P^x{k) + P,v{k) + v{k + 1), 

x{k + H^) = Pf "a;(fc) + Y.f^^\P^--'-Mk+j)), 
x{k + Hu + l)^ P/^"+ia;(fc) + j:f=o^iPe"-~'vik + j)) 
+ [P, + I)v[k + H^-\), 



x{k + Hp) = Pf-x(fc) + Ef:o^iP"'~'~'^ik + j)) 
+ J2f^-"-Pivik + H^-l). 

Here, the integers Hp and represent the prediction 
and control horizons, respectively. More specifically. Hp 
defines the number of future steps which have to be pre- 
dicted, while Hu is the length of the future predicted 
control sequence. By definition, the following relation 
holds: Hu < Hp. 

In this way, the future evolution of the network can be 
predicted Hp steps ahead, as 



. e = ei 



X{k + 1) = Pxx{k) + PuU{k), 

with 

X^{k + 1) = [x^ik + l),...,x^{k + Hp)]^^^ ^ , 
U^{k) = [v^{k), v^{k + H^~ 1)] ' ' 



(8) 



P^ 



, and the expression of 



pL---,(p"'y 

^ ' ^HpNxN 

Pu given by l(4T|) in Appendix]^ 

Bearing in mind the goal of consensus protocol, i.e. 
eliminating the disagreement of all the individuals of the 
network, we first calculate the state difference of agents 
i and j in the network, m (1 < m < Hp) steps ahead, 
using the operator 

Aa;ij-(fc+m) = Xi{k-\-m) — Xj{k-\-m) = ei,jx{k+m), (9) 



where Ci 



- ej and Cj 



[0,- 



,0,, 1 ,,0, 



,0] 



IxJV- 



Based on |[9]), the network state difference vector to (1 < 
w < Hp) steps ahead can be defined by 

Ax{k + m) = [Ax'[^2{k + m),..., Ax^^^fik + m), Ax'^^sik + m) 
ik + m), . . . , Axjf-i^jv '^JJ JV(]V-l)/2xl ' 

Consequently, the future evolution of the network's 
state difference can be predicted Hp steps ahead as fol- 
lows: 



Ax{k + 1) = ex{k + 1), 



Ax{k + Hp) = ex{k + Hp 



(10) 



with r ^ '-^ 

A 



=l,2i • ■ • ) tii^jV) '^2,3) • • • ) 62,JV, • • • ) ejv_l,JvJjv(JV_i)/2x]V) 

It then follows from ifTOl) that 



AX{k + l) ^ \Ax(k + l)'^,...,Ax{k + Hj,)'^Y 
= EX{k + l)=E{Pxx{k)+PuU{k)) 

= PxEx{k)+PuEU{k) (11) 

with E = diag(e, . . . , e)H^NiN-i)/2xHpN, Pxe = EPx 
and PuE — EPfj. 

To solve the consensus problem, we first set the moving 
horizon optimization index that defines the MPC consen- 
sus problem as follows: 



J{k) = \\AX{k + l)\\l + \\Uik)\'' 



R ' 



(12) 



where Q and R are compatible real, symmetric, positive 
definite weighting matrices, and ||M||q — M^QM. In 
general, the weighting matrices can be set as 



Q = qlHpN{N~i)/2 [q > 0) and R = Ih, 



N- 



(13) 



In the optimization index l|T2|) . the first term penalizes 
the state difference between each pair of states over the 
future Hp steps, while the second term penalizes the ad- 
ditional MPC control energy v{k). In order to minimize 
(fT2l) . we compute dJ{k)/dU{k) = 0, and obtain the op- 
timal MPC action as: 



where 



v{k) = PMPcx{k), 

Pmpc = - [Ini^Nt ■ ■ ^On]xxh^n 

■{pSeQPue + R)-'pSeQPxe, 



(14) 



(15) 



In e R'^''''' and Oa, e M''"''^ are the identity and zero 
matrices of dimension N, respectively. The associated 
closed-loop dynamics can then be written as 



x{k + l) = {P,+PMPc)x{k). 



(16) 



Interestingly, the proposed algorithm shows some con- 
sistency with the routine protocol More precisely, 
the latter is solely based on the current state difference 
Axij{k) of each pair in the network while the former 
roots not only in the current state difference Axij{k) 
but also in the future state difference Axij{k+m), which 
constitutes the main improvement of this method. 



B. Analysis 

For symmetric all-to-all link networks, it can be shown 
that Pmpc and P^ share the same eigenvectors. The fol- 
lowing theorem states this eigenvector conservation prop- 
erty in more details. 
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Theorem 1 (Eigenvector conservation theorem) 

Consider an N-node, all-to-all, symmetric network 
whose dynamics are described by (3) and JJ^p , and with 
the associated weighting matrices given by (03). If K 
and rji denote the i*^ eigenvalue and the corresponding 
eigenvector of Pe, respectively, then Pmpc (see ( 05]) ) 
satisfies the following relations: 



th 



eigenvalue of 



1- Pmpc ■ ili — Vi ■ rji , where Vi is the i 
Pmpc corresponding to rji; 

^- Pmpc = Pmpc ■ 

Proof: See Appendix\T[ 
It follows from T/ieorem 01 that 



[Pe + Pmpc) = A, (PJ + A, (Pmpc) , i^l,...,N, 

(17) 

where Xi{A) denotes the i*'' eigenvalue of the matrix A. 
For an arbitrary eigenvalue Xi {I < i < N) of P^, the 
associated eigenvalue of Pm pc , t^i, is given by 



-JiiHu,Hp,Xi,q), 



(18) 



which can be calculated by (|44l) given in Appendix]^ 

In particular, the eigenvalue of Pmpc corresponding to 
the trivial eigenvector 1 is I'l = 0. This latter property 
can be generalized to balanced networks as summarized 
in the following corollary. 

Corollary 1 Consider an all-to-all N-node network 
whose dynamics are described by iQ) and il4\! , and with 
associated weighting matrices given by ^3\) . If the net- 
work is balanced, then the matrix Pmpc (see I115\} } is 
balanced in the sense that Pmpc! — Pmpc^ ~ ^ ^^'^ 
0=0-1. 

Proof: For balanced networks P^ (see |[5j), it is obvious 
that 



P^l ^Pj 1^ 1. 



(19) 



Using ([19| . a similar proof as the one given to The- 
orem Qshows that PxeIh^nxi = EPxIh^nxi = 
P^[i^---^i]H^Nxi = [0'---'0]ffpjv(A'+i)/2xi' ^hich leads 
to Pmpc! = 0. In other words, the eigenvalue of Pmpc 
associated with the trivial eigenvector 1 is 0. Moreover, 
it is easy to see that 

[In,0n,...,0n]j^^h^j^ = [j^,0^,...,0^] (PSeQPue+R). 

(20) 

Since PijeQPue + i? is invertible, it follows from i(20|l 
that 



{P^eQPue + R)- 



(21) 



Substituting ^ into ^ yields that I^Pmpc = CF ■ 
Thus, Pmpc is balanced in the sense that 1^ Pmpc = 0^ 
and PmpcI = 0. ■ 



A direct consequence of Corollary 01 is that the state 
matrix of the MPC protocol P^ + Pmpc is balanced in 
the sense that (Pe + PmpcVi = {Pe + Pmpc)1 = 1- 

Note that balanced networks are more general than 
symmetric networks, thus Corollary 01 is more general 
than TheoremUi 

Based on TheoremUiand Corollary\^ we give hereafter 
necessary and sufHcient conditions guaranteeing asymp- 
totic convergence to the average-consensus for the pro- 
posed MPC protocol (see ^ and (fT4l) ). 



Lemma 1 For any matrix W E R^^^, the equation 

rk _ ..T/^r ^22) 



lim W'' = ll^/N 

k — >oo 



holds if and only if either assumptions Al and A 2 hold 
or assumptions Al and A3 hold 



Al: 



A 2: 



and Wl 



(23) 



p{W-lF/N)<l, (24) 
where p(-) denotes the spectral radius of a matrix; 

A3: the matrix W has a simple eigenvalue at 1 and all 
its other eigenvalues in the open unit circle. 



<^ Assumptions 
171 I. The proof of 



Proof: The property "Equation ([22 
Al and A2 hold" has been proven in 
the the property "Equation -i^ Al and A3 hold" is 
provided in Appendix[M B 

Based on Lemma 01 and Corollary 01 some necessary 
and sufficient condition of the proposed MPC protocol 
(see ^ and Jill)) is provided as follows. 



Theorem 2 For the closed-loop system ( tig)) associated 
with an N-node all-to-all, balanced network whose dy- 
namics are described by ^ and Iil4\ ), the system state 
x{k) asymptotically converges to the equilibrium point 
x{0)l with x{Q) = i/NJ2i=iXi{0) if and only if either 
of the following two assumptions holds 

A4: p{P, + Pmpc - 11^ /N) < I; 

A5: the matrix P^ + Pmpc has a simple eigenvalue at 1 
and all its other eigenvalues in the open unit circle. 



Proof: The asymptotic state value x* of the closed- 
loop system ifTBj) is given by 



(25) 



X* ^ lim(P+PMPc)'=x(0). 



Let W = Pf -\- Pmpc- Then, Coronary 01 implies that 
(|23l) holds. It then follows from Lemma 01 that 



x* = lim iPe + Pmpc) x{0) = liyN-x{0) = x{0)l 

k^oo 
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if and only if either of the two Assumptions A4 or A 5 
holds. ■ 
Bearing in mind the balanced feature of Pmpc, it can 
be proven, using the Gersgorin Disc Theorem [2J|, that 
(i) for fixed values of e, the MPC protocol can compress 
the corresponding cluster of eigenvalues and drive it to 
approach the origin; (ii) the MPC protocol can signifi- 
cantly expand the feasible range of e. Details of these 
statements are given in the following lemma and theo- 
rem. 

Lemma 2 (Gersgorin Theorem [24'|) Let 

A = {a^j}i,J=l^„„N ^ M^^^, and let R',{A) = 

J2j=i j^i ku li i — 1,2, . . . , N . Then all the eigenvalues 
of A are located in the union of the N discs 

U'l^, [z e C : \z - au\ < R'M)}. (26) 





1 


-if 1 










-1 



-1 1 

Real 



Thus, taking Theorem\^'mto consideration, one can con- 
clude that average-consensus will be achieved asymptot- 
ically. ■ 

Remark 1 The assumptions j3ij > {i ^ j) and Pa G 
(0, 1] can be easily satisfied in general. Indeed, it can 
be numerically checked that in the i- dimensional space 
spanned by the parameters H^, Hp, and q, there is a 
fairly large region in which these two assumptions are 
satisfied (such as the region corresponding to the com- 
mon parameter settings Hu G [1, 10], Hp e [i7„, 10], and 
q G [0.1,10]/ Moreover, the circle determined by f28]) 
shrinks with increasing values of 13nn [Pnn G (0, 1)), 
and the conditions given in Theorem\^thus become more 
and more restrictive. Fortunately, for the common pa- 
rameter settings H^ G [1,10], Hp G [i?„,10], and q G 
[0.1, 10], it can be shown by simulations that /3nn is gen- 
erally very close to zero when e < 20/dmax, thereby reduc- 
ing the conservativeness of the conditions of Theorem [H 
In this way, the feasible range of the sampling period e 
is significantly broadened. Indeed, when the routine state 
matrix is not discrete-time Hurwitz (which happens for 
l/c^max < e 1^4,]) J MPC state matrix Pe + Pmpc will 
still be discrete-time Hurwitz if l/dmax < e < e where e 
is a certain threshold, typically much larger than l/dmax- 
As shown in Theorem Wi this is due to the fact that the 
MPC consensus protocol is able to compress the cluster 
of eigenvalues and drive it to approach the origin when e 
grows larger than the threshold value l/dmax; as will be 
illustrated later, in the case study. 



FIG. 2: (Color online) Illustration of Theorem[3[ 

Theorem 3 Consider an all-to-all, strongly connected, 
balanced network whose dynamics are described by ^ 
and jlj^ . Denote each entry of Pe-\- Pmpc by f3ij, i,j — 
1, . . . , N. Under the assumptions that f3ij > (i 7^ j) and 
Pa G (0,1], the network state x{k) will asymptotically 
converge to a; (0)1. In other words, average-consensus 
will be achieved asymptotically. 

Proof: It follows from Corollary Q] that (Pe -I- 
Pmpc)1 = 1- Moreover, since (3ij > {i ^ j), one has 

R',{Pe+PMPc) = Ef=l,J^^P^J = ^-^u- From Lemmam. 
one obtains that all the eigenvalue of P^ -f Pmpc are lo- 
cated in the union of the N discs 

ur=i{zGC: < 1-/3,J, (27) 

as shown in Fig. [51 Therefore, if fin G (0, 1], then all the 
eigenvalues of the state matrix Pc-\-Pmpc are in the open 
unit circle, except the simple eigenvalue 1. Moreover, if 
the Pa, i = 1, . . . , N are arranged in non-ascending order, 
i.e. < Pnn < /Jjv-i.A'-i < ■ • ■ < Pii < 1, as shown in 
Fig. [21 then the union of the N discs (|27l) equals 

{zeC:\z-PNN\<l-pNN}. (28) 



C. Case study 

To vividly illustrate the advantages of the MPC con- 
sensus protocol, we present some simulation results com- 
paring the convergence speeds obtained using the routine 
protocol given in ([3]) and the proposed MPC protocol 
given in (fT4|) for the particular case of all-to-all, bal- 
anced networks. 

We first consider an all-to-all, symmetric network of 10 
nodes. Since the objective is to reach average-consensus, 
the instantaneous disagreement index is typically set as 
D{k) = ||a;(fc) — J2:(0)||2 and the consensus steps can 
be defined as the running steps required for D{k) to reach 
a specified neighborhood of the origin and stay therein 
afterwards, i.e. 

Tc{Dc) ^ min {T G IR+ : D{k) < Dc, Vfc > T} , (29) 

where Dc is a positive number defined as the consensus 
threshold, and ||a;||2 = (x^a;)^/^. It is clear that l/Tc{Dc) 
gives a reasonable measurement of the consensus speed. 

As shown in Fig. [H^a), the addition of the predictive 
mechanism defined in lfT4l) . yields a drastic increase in 
convergence speed towards consensus. In particular, for 
e <C l/(imax (f^max = niax^ {la)), the convergence speed 
is increased more than 20 times by using the proposed 
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FIG. 3: (Color online) (a) Comparison of the routine (black 
curves) and MFC (blue curves) protocols on the time evo- 
lution of the instantaneous disagreement index D{k) corre- 
sponding to an all-to-all, symmetric network with different 
sampling periods e. Here, kj — ~1 {i ^ j) and la = N — 1. 
Case 1: e — 1/9 = 1/dmax, 0: MFC, O: routine protocol; 
Case 2: e = 0.03 < 1/dmax, V: MFC, A: routine pro- 
tocol; Case 3: e = 2.00 > 1/dmax, □: MFC, *: routine 
protocol. (b) Comparison of FDLA (black curves) and 
MFC (blue curves) protocols on a symmetric network with 
each off-diagonal entry Uj = Iji {i 7^ j) selected randomly 
in [-1,0]. Here 0: MFC; +: FDLAl; □: FDLA2, e = 0.20 
and dmax — 5. In both (a) and (b), the MFC parameters 
are A'^ = 10, Hu = 2, Hp = 4, q = 2, and the initial states 
Xi{0), i — 1, . . . , N are selected randomly in [0, 15]. 

MPC protocol. Furthermore, even when the routine con- 
vergence conditions are violated, i.e. e > l/dmax, it is 
observed that the MPC consensus protocol still allows 
asymptotic convergence with a high-speed. 

To further illustrate the advantages of the MPC pro- 
tocol, comparison results of this latter protocol with 
the fastest distributed linear averaging (FDLA) proto- 
cols proposed in |T3| are presented in Fig. [3jb). More 
precisely, there are mainly three kinds of FDLA: if the 
dynamics of the considered network is determined by 
x{k + 1) = Wx{k), then 

• in FDLAl, namely the best constant method, W = 
In - aL with a = 2/{\2{L) + Xn{L)). FDLAl is 
applicable only to symmetric networks; 

• in FDLA2, namely the maximum- degree weight 
method, W = In ~ aL with a = l/dmax- FDLA2 
is applicable only to symmetric networks; 

• in FDLA3, namely the spectral norm minimization 
method, W is the solution of the following spectral 
norm minimization problem: 

minw \\W-11^/N\\ 

s.t. we£, I'^w ^ 1^ , wi = 1. ^ ' 

It has been proven that the optimization problem (|30| in 
FDLA3 is convex, thus FDLA3 can yield a global opti- 
mum W* for the consensus problem[17|. Additionally, we 
note that FDLA2 is typically slower than FDLAl. The 
convergence properties of both FDLAl and FDLA2 are 
described in llTll. 



It can be observed from Fig. Eljb) that the consen- 
sus speed of the proposed MPC protocol is much faster 
than that of FDLAl and FDLA2, which is due to the 
larger degree of freedom allowed by the state matrix 
W = Pe + Pmpc- As to FDLA3, one can get that 
the optimum W* = 1^ 1 /N for all-to-all link networks. 
As a consequence, a;(l) = Wx{0) = Ix, namely, the 
disagreement index D{k) will be zero in just one step, 
making FDLA3 the fastest possible consensus algorithm 
for all-to-all link networks. We have proven in Theo- 
rem[lthat the state matrix of the MPC protocol satisfies 
limfe^oo(^e + Pmpc)'' = W* , provided that the matrix 
Pf + Pmpc has a simple eigenvalue at 1 and all its other 
eigenvalues in the open unit circle. Furthermore, con- 
sidering all-to-all link networks, the constraints imposed 
in ([30]) are all fulfilled for W = P^ + Pmpc- Interest- 
ingly, we observe in Fig. [3] that (Pg + Pmpc)'' quickly 
approaches W* — 1^1 /N, which nicely illustrates the 
results presented in Theorem[E 

To further compare the convergence performances of 
the MPC and the routine protocols, we now general- 
ize the above all-to-all, symmetric networks to an all- 
to-all, asymmetric, balanced networks with off-diagonal 
entries a^ , i ^ j selected randomly from [—1,0]. The 
corresponding time evolution of the instantaneous dis- 
agreement index D{k) is fairly similar to the one pre- 
sented in Fig. [3] for a symmetric all-to-all topology and 
is thus omitted here. Nevertheless, we show their as- 
sociated ultrafast-convergence probabilities Pc{Dc) with 
respect to e in Fig. IHa). Here, Pc{Dc) denotes the 
ratio of ultrafast-convergence runs over 500 runs for 
each e. A convergence run is considered ultrafast if 
the consensus threshold Dc — 0.01 (see l(29|) ) can be 
reached within 100 steps. It can be observed that, with 
the assistance of a predictive mechanism, the ultrafast- 
convergence probability is significantly increased for each 
fixed value of e. Furthermore, the maximum feasible 
ultrafast-convergence sampling period e is also sharply 
increased (more than 40 times from our simulation re- 
sults). 

To further study the effects of the predictive mecha- 
nism and analyze its impact on the feasible convergence 
range of sampling periods e, we examine in Fig. IHb) the 
evolution of the consensus steps TcCO.Ol) of these two 
strategies with respect to increasing values of e. In this 
comparison, for each value of e, Tc denotes the average of 
the consensus steps corresponding to the successful con- 
vergence runs over a total of 500 runs. It can be seen 
that, compared with the routine protocol, the MPC pro- 
tocol allows for a significant increase in the consensus 
speed 1/Tc(0.01) (by a factor between 6 and 20 in our 
simulation results). 

Since there are three crucial parameters determining 
the performances of the proposed MPC protocol, namely 
Hp, Hu and q (see (fT3| ). statistical simulations have been 
carried out to investigate their individual infiuence on the 
convergence speed. The results of these simulations are 
shown in Fig. [5j One can observe that (i) the consensus 
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FIG. 4: (Color online) (a): All-to-all link network's ultrafast- 
convergence probability (Pc(O.Ol)); (b): consensus steps 
(rc(O.Ol)). Comparison is addressed between the MFC (red 
curves) and routine (blue curves) protocols with different sam- 
pling periods e and 500 independent runs for each value of e. 
In these simulations, Hu = 2, Hp = 4, q = 2, the consensus 
threshold Dc — 0.01, each entry / j) of L is selected 
randomly in [—1,0], and Xi{0) {i = 1, . . . , N) is selected ran- 
domly in [0, 15]. The corresponding values of dmax lie in the 
range [4.5,6.2]. The vertical dotted lines correspond to the 
minimum and maximum values of 1/dmax. 




(c) (d) 

FIG. 5: (Color online) Evolution of the consensus steps 
imiQ-'')) of the MFC consensus protocol with respect to 
the control horizon Hu, the prediction horizon Hp and the 
weighting parameter q. Here, the threshold Dc = 10~^, and 
the sampling period e — 0.05. 



speed 1/Tc(10~'') is enhanced with increasing values of 
the parameters Hp (see Fig. [UJa)) or q (see Fig. [5l[c)); 
(ii) a global maximum of 1/Tc(10~^) exists at a value 
of Hu (see Fig. (Hb)). Furthermore, T^IQ-'^) remams 
stable when H^ exceeds a specified threshold (see also 
Fig.lHb)). 

Generally speaking, an increase in the values of Hp, 
and q, can improve the overall consensus performance. 



However, when their corresponding values exceed some 
thresholds, this improvement becomes neghgible. Mean- 
while the control efforts and computational burdens are 
still drastically increased (see Fig. [5l[d)). Consequently, 
taking into consideration both computational complex- 
ity and consensus speed, one can find optimal parameter 
values according to the statistical simulation results de- 
picted in Fig. [5j 




_4 ~2 2 -15 -10 -5 5 



Real Real 

(c) (d) 

FIG. 6: (Color online) Eigenvalue distributions with respect 
to the sampling period e. Blue O and red -I- denote the eigen- 
value distributions of Pc and Pe + Pmpc over 100 runs, re- 
spectively. The black circle represents the unit circle in the 
complex plane. Here, Hu = 2, Hp = 4, q — 2, and the entries 
'iji j 7^ i oi L are chosen randomly from [—1,0]. The cor- 
responding values of dmax lie in the interval [4.5, 6.2] in this 
100-run simulation. 

It is well known that the eigenvalue distribution of the 
state matrix associated with the considered consensus 
protocol, i.e. + Pmpc, is closely linked to its perfor- 
mances. Therefore, to further study the proposed MFC 
protocol and better understand its ultrafast-convergence 
capability, we display the eigenvalue distributions of P^ 
and Pe + Pmpc in Fig. [6l These statistical simulations 
have been realized by considering 100 different runs for 
a balanced, asymmetric network with entries kj, i ^ j 
of the Laplacian matrix L (appearing in the definition of 
the matrix P^, see lHJ) randomly selected from [—1,0]. 
For each run, we have considered 4 different sampling 
period values for e. Based on these simulation results, an 
interesting phenomenon can be observed: the eigenvalue 
cluster of the matrix P^ + Pmpc is always more compact 
around the origin than the counterpart cluster of Pe ■ 

With these eigenvalue distributions, we can visualize 
the advantages of the MFC protocol more lively. Indeed, 
since the eigenvalue cluster of P^+Pmpc is always much 
smaller and closer to the origin of the complex plane than 
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that of Pe, the MPC protocol generally has better con- 
sensus performance. When e < l/dmax (e = 0.05, see 
Fig. [Ha)), the two eigenvalue clusters both remain in- 
side the asymptotic stability region, i.e. the unit circle 
in the complex plane. However, since each eigenvalue of 
Pc -f- Pmpc is much closer to the origin, the consensus 
speed is sharply increased in the case of the MPC pro- 
tocol. Furthermore, when e > l/dmax (e = 0.60,2.00, 
see Figs.[6l[c) and (d)), some of the eigenvalues of Pg es- 
cape the unit circle, making the disagreement function 
diverge, whereas all the eigenvalues of P^ -I- Pmpc re- 
main inside the unit circle, guaranteeing its asymptotic 
convergence. Finally, still worth mentioning is that the 
trivial eigenvalue of Pe -I- Pmpc, which corresponds to 
the eigenvector 1, always remains at 1 irrespective of the 
value of e. 

In summary, the advantages of the proposed MPC pro- 
tocol are twofold: (i) enhancing the consensus speed as- 
sociated with a fixed value of the sampling period e; (ii) 
enlarging the range of feasible convergence sampling peri- 
ods. From the natural science point of view, the proposed 
MPC protocol, and especially its predictive mechanism, 
can be used to explain why individuals of bio-groups do 
not communicate with each others very frequently but 
only occasionally in a suitable manner during the whole 
dynamic process. From the industrial application point 
of view, due to the enlargement of the feasible range of 
the sampling periods, the use of the proposed MPC pro- 
tocol allows for a significant reduction of the communica- 
tion costs required to achieve a desired consensus speed. 



IV. MODEL PREDICTIVE CONSENSUS 
PROTOCOL FOR PARTIAL LINK NETWORKS 

In this section, we further compare the routine and 
the MPC consensus protocols in the more general case of 
partial link networks in which a pair of nodes is not neces- 
sarily connected. If we allow the topology of the network 
to be changed, in other words, if we allow the addition 
of some new edges in the graph, then the MPC proto- 
col lfT4|) proposed for all-to-all link networks can be used, 
and thus Theorems and Corollary [7] remain valid. 
However, if we assume that the initial sparsity structure 
of the network is fixed, i.e. no new edge can be added in 
the graph, then we need to revise the MPC protocol lfT4|) 
to obtain a new one suitable for this type of scenario. 
In the following sections, we first introduce a revised 
partial link, sparsity-preserving MPC consensus proto- 
col. Afterwards, to support this latter protocol, we derive 
some necessary and sufficient condition guaranteeing its 
asymptotic convergence towards average-consensus. Fi- 
nally, we provide simulation results for balanced partial 
link networks that show the advantages of this MPC pro- 
tocol. 



A. Algorithm 

In partial link networks, each node is allowed to com- 
municate solely with its neighbors. To ensure that the 
communication structure of the network G — {V,£,A) 
is preserved, one can slightly revise the additional MPC 
term v{k) appearing in ^ to v{k) — Qx{k), which leads 
to the following linear network dynamics 

x{k + l) = P,x{k) + ex{k), (31) 

where 6 = jy ^ R^^^ satisfies the following 

relations: 

1. the matrix Q has the same sparsity structure as 
that of the network, i.e. 

i^j ^0^, =0; (32) 

2. the matrix 8 will not change the symmetric prop- 
erty of the network, i.e. 

= A ^ = 9; (33) 

3. 8 is balanced in the sense that 

61 = 9^1=0. (34) 

Note that these constraints are given to ensure feasibility 
of consensus by the proposed MPC protocol, which will 
be proven later. Fortunately, with these conditions, the 
degrees of freedom of 9 are reduced and the computa- 
tional complexity of the proposed MPC algorithm is thus 
reduced. 

By iterating the dynamic model given in (|3T|) , the evo- 
lution of the state of the j*'' agent can be predicted as 

Xjik + m) = e,{P, + erx{k), 

m^l,--- ,Hp; J ^l,--- ,N, ^"^^^ 

with Cj = [0, • • • , 0,^^^!^, 0, • • • , 0]ixAr. Similar to the all- 

to-all link case, the m-steps-ahead state difference of the 
and j*'' agents can be calculated by However, 
in this partial link case, the m-steps-ahead network state 
difference vector, i.e. Ax{k -\- m), is solely composed of 
the state differences of the neighboring pairs, i.e. Aa;(fc-|- 
m) = (col {Axi^j{k + m)\{i,j) e E)f . Note that if both 
(i,j) and (j, ?) are in £, only Xij{k + m), i > j will 
appear in Ax{k + m). 

Accordingly, the future evolution of the state difference 
can be predicted Hp steps ahead: 

Ax{k + 1) = ex{k + 1), 

: (36) 

Ax{k + Hp) = ex{k + Hp), 
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with e = (col {efj\{i,j) € £)) and Cij = Ci — Cj. Note 
that if both (i, j) and are in £, only e^.j, i > j will 
appear in e. Then, substituting (|3T1) into l|36p yields 



AX{k + l) ^ [Ax^{k + 1) 

T 



= EX{k+l) = E 
with E = diag(e, . . 



re). 



ey 



T 
'l T 

x{k), 
(37) 



Analogous to what we have considered in the all-to- 
all link network case (fT2|) , the optimization index of the 
network here is designed as follows: 

j{e,k) = \\Ax{k + i)\\l + \\exik)\\% (38) 

where Q and R are positive definite symmetric weighting 
matrices. Thus, it follows from (l37l) and ll38l) that 



(39) 



j(e,fc) = x^ik)Jinie)x{k) 



with J„(e) = T'^E'^QET + Q'^ RQ and T = 

(p, + e)^ , . . . , ((p, + e)^- 

Consequently, control law 8 can be derived as follows 

aj™(e)/a%|(,,,)e£ -0. (40) 

which leads to a set of polynomial equations. To solve 
this, Groebner basis methods can typically be used if the 
dimension of the problem to solve is not too high. Indeed, 
such methods allow to find all the solutions to a set of 
polynomial equations in several indeterminates, if the so- 
lution set consists of a finite set of isolated points [2^ . 
Note that in the partial link case ((3T |) - (|40| . the control 
horizon iJ„ is always one. Certainly, one can extend Hu 
by setting different values of 6 for different future steps; 
however, the computational burden will thereby increase 
remarkably. For this reason, multiple-step control hori- 
zons are not preferred for partial link networks. 

B. Analysis 

In this section, based on Lemma[I\ we provide a nec- 
essary and sufficient condition ensuring asymptotic con- 
vergence of the partial link MFC consensus protocol (see 
(|3T1) - l(34|) and (|40l) ) towards average-consensus. 

Theorem 4 Consider a dynamical network Gx whose 
dynamics are determined by the MFC protocol given in 
^31]) and 114 and which satisfies the conditions (EE) and 
Jg^p . Then Ihnk-^oo x{k) = lx{0) (or average-consensus 
is reached asymptotically) if and only if either of the fol- 
lowing two assumptions holds 

A6: p{Pe + e- 11^ /N) < 1; 

A 7: the matrix Pe + Q has a simple eigenvalue at 1 and 
all its other eigenvalues in the open unit circle. 



Proof: It follows from ^ and ^ that (P^ + &)! = 
(Pf -t- Q)^ 1 = 1. Moreover, it can be seen from (|32l) that 
the sparsity structure of the matrix Pe + Q corresponds 
to the one initially imposed by £. Thus, taking into con- 
sideration of Lemma [2 the following equation holds: 

lim x{k) = lim (P, + Q^xiO) = ll^/Nx{0) = lx{0) 

k — ^oo k — ^oo 

if and only if either Assumption A6 or A7 is satisfied. 



Remark 2 It will be illustrated later by simulations that 
Assumption A6 or Al holds when t grows to be much 
larger than 1/cimax- For partial link networks, one can 
generally compute a numerical solution (see {4C^) rather 
than derive the corresponding analytical solution, thus the 
analysis cannot be formulated as thoroughly as for the all- 
to-all link case. However, the rationale of the predictive 
mechanism (3T\) -(4^ is quite clear, i.e. the role of the 
routine part of the protocol (Pf_x{k) ) is to drive the state 
x{k) to the average-consensus point lx{Q), while the role 
of the MFC part (Qx{k) ) is to accelerate the consensus 
process by minimizing the future state difference between 
each neighboring pair in the network. 



C. Case study 

In this section, we present some simulation results to 
compare the convergence speeds obtained using the rou- 
tine consensus protocol given in the FDLA protocol 
given in (|30|) . and the proposed MFC protocol given in 
(l31])-([34]) and |[40]) for the case of partial link networks. 
Moreover, through these simulation results, one can also 
appreciate the difference in performances of the proposed 
MFC protocol for both all-to-all link and partial link net- 
works. 





2 4 6 

k (running step) 
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FIG. 7: (Color online) (a): balanced network topology; (b): 
time evolution of D{k) — \\x{k) — ia;(0)||i when considering 
the MPC (blue curves), routine (black curves) and FDLA3 
(red + curve) protocols with different sampling periods e. 
Case l:e = 1/3 = 1/dmax, 0: MPC, O: routine proto- 
col; Case 2: e = 0.01 < 1/dmax, A: routine protocol, V- 
MPC; Case 3: e = 1.00 > l/dmax, □: MPC, ★: routine 
protocol. In these simulations, = 10, Hu = 1, Hp = 4, 
g = 2, and Xi{0) (i — 1, . . . , N) is selected randomly in [0, 15]. 

dmax — mclXi (/ii) — 3. 
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FIG. 8: (Color online) (a): symmetric network topology; (b): 
time evolution of D(k) — \\x{k) — x{0)l ||i when considering 
the MFC (blue curves), routine (black curve) and FDLA3 (red 
curves) protocols. Here (}: MFC; A: routine; +: FDLAl; □: 
FDLA2; ★: FDLA3. The MFC parameters are iV = 10, 
Hu = 1, Hp ^ 4, q = 2, a;,(0) (i = l,...,iV) is selected 
randomly in [0, 15], dmax = maxi (la) = 4 and e = 0.1 < 
1/d 

max ■ 



fastest possible way Moreover, it has been proven in 
Theorem\^that consensus will be asymptotically reached 
provided that Assumption A6 or A 7 holds. Also, it can 
be shown by simulations that Assumption A6 or ^47 gen- 
erally holds even when e grows much larger than 1/dmax, 
and that (Pe + 6)*^ typically approaches 1 1'^ /N in just 
a few steps. 
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In these simulations, we have considered a 10-node 
asymmetric partial link network whose topology is given 
in Fig. [Tlja) (see [Hi). For this partial link network 
G = {V,£,A), the initial weights are fixed as follows: 
if & £, i j, then a^- = 1; otherwise, fly = 0. 

As shown in Fig.jTlJb), three different kinds of consensus 
strategies, i.e. the MPC (see ll31])-(l34l) and (gOl)), routine 
(see (lU) and FDLA3 (see l(30|) ) protocols, are compared. 
It can be observed that FDLA3 still holds the highest 
possible convergence speed while the addition of a pre- 
dictive mechanism computed according to (|3T|) - l(34|) and 
(|40| yields a drastic increase in the convergence speed 
towards consensus compared with the routine protocol. 
Similar phenomena as those observed in the all-to-all link 
cases (see Fig. [3]) can also be observed: for e <C 1/rfmax, 
the convergence speed is increased sharply with this MPC 
protocol; for e > l/dmax, the routine consensus proto- 
col diverges while for e values belonging to the interval 
(l/rfmax,e) with e> 1/d max) the MPC protocol still con- 
verges with high-speed. Therefore, the feasible conver- 
gence range of e is remarkably expanded by the proposed 
MPC protocol. More interestingly, for e l/rfmax, the 
consensus speed of MPC approaches the fastest possible 
speed yielded by FDLA3 and is thus nearly maximized 
with the addition of a predictive mechanism. 

To illustrate the advantages of the MPC protocol more 
vividly, we present in Fig.[8ljb) a comparison of the MPC, 
routine, FDLAl, FDLA2 and FDLA3 protocols (see l(30l) ) 
when implemented on the symmetric network structure 
described in Fig. [HJa). In this case, the simulations were 
carried out with the fixed sampling period e = 0.1. For 
this partial link network G — (V, £, A), the initial weights 
are fixed as follows: if G z 7^ j, then = 1; 

otherwise, Uij = 0. It can be observed from Fig. ^h) 
that the consensus speeds of MPC and FDLA3 are much 
higher than those of FDLAl and FDLA2, which is due to 
the larger degree of freedom of the corresponding state 
matrix W. Compared with MPC, FDLA3's speed is even 
higher, since FDLA3 yields the global optimum W* in the 



FIG. 9: (Color online) (a): partial link network's ultrafast- 
converge probability (Pc(O.Ol)) and (b): consensus steps 
(rc(O.Ol)). Comparison is addressed between the MFC (red 
curves) and routine protocols (blue curves) with different sam- 
pling periods e and 500 independent runs for each e. For these 
simulations, Hu — 1, Hp — 4, q = 2, the consensus thresh- 
old Dc = 0.01, initial states 2:^(0), i = 1,. . . ,N are selected 
randomly in [0,15], and all non-zero entries / j) of L 
are selected randomly from [—1,0]. The corresponding values 
of dmax lie in the range [0.9,2.7]. The vertical dotted lines 
correspond to the minimum and maximum values of 1/dmax. 

To compare the convergence performances of the MPC 
and routine consensus protocols for the asymmetric 
topology described in Fig. [7l we show their ultrafast- 
convergence probabilities Pc(O.Ol) with respect to e in 
Fig. [HJa) . As previously, a convergence run is considered 
ultrafast if Dc = 0.01 can be reached within 100 steps. It 
can be observed that, with the assistance of the predic- 
tive mechanism, the ultrafast-convergence probability is 
significantly enhanced for all fixed values of e. Further- 
more, the range of feasible convergence sampling periods 
is also sharply expanded (by a factor 10 in our simulation 
results). 

To further study the newly introduced predictive mech- 
anism (|3T1) - l(40|) and to analyze its impact on the feasible 
convergence range of sampling period e, we examine in 
Fig. IHb) the evolution of the average value of the con- 
sensus steps Tc(O.Ol) (see (|29l) ) of these two strategies 
for the ultrafast-consensus runs. It can be seen that, 
compared with the routine consensus protocol, the use 
of MPC leads to a significant increase of the consensus 
speed l/rc(0.01) (by a factor between 5 and 12 in our 
simulation results). 

Compared with the all-to-all link network case, the 
performance improvements of partial link networks are 
generally reduced. This should be attributed to the fact 
that each node of an all-to-all link network can use the 
information of all the other ones for prediction, whereas 
the information fiow in a partial link network is con- 
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strained by its topology. Moreover, another interesting 
phenomenon deserving notice is that, for the routine con- 
sensus protocol, the Pc(O.Ol) curve starts with a very low 
value for small e, ascends to the peak (which correspond 
to about 80%) in the left half of the dmax zone and finally 
returns to zero very quickly within the right half of the 
rfmax zone. This phenomenon should also be attributed 
to the information fiow constraints imposed by the par- 
tial link topology and the fact that the routine protocol 
convergence speed is maximized when e = l/dmax (see 
FDLA2 in 
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FIG. 10: (Color online) partial link network's eigenvalue dis- 
tribution with respect to the sampling period e. Blue O 
and red -I- denote the eigenvalue distributions of Pe and 
{Pt-\- Pmpc) over 100 runs, respectively. The black circle rep- 
resents the unit circle in the complex plane. Here, Hu = 1, 
Hp — A, q — 2. According to the network topology (see 
Fig. Ola)), each non-zero entry hj {i 7^ j) of L is selected ran- 
domly in [—1,0], and it is calculated that dmax £ [0.9,2.7] in 
this 100-run simulation. 

To investigate MFC's ultrafast-consensus capabilities 
even more carefully, we compare the distribution of eigen- 
values for the two matrices Pe and Pc + Pmpc in Fig.fTOl 
Similar to the all-to-all link network case, these statis- 
tical simulations have been realized by considering 100 
different runs for an asymmetric balanced network with 
the topology shown in Fig. [7^a). In these simulations, 
each non-zero entry kj, i 7^ j of L is selected randomly 
in [—1,0] at each run. For each run, we have considered 
4 different sampling period values for e. Based on these 
simulation results, similar phenomena to those reported 
in the all-to-all link network case (see Fig. [6l) can be ob- 
served. Compared with the eigenvalue-cluster of P^, the 
one of Pf + Pm pc is always much smaller and closer to 
the origin, which explains the overall higher consensus 
speed of the MFC protocol. Moreover, if e approaches 



l/'^max (e = 0.56, Fig. [TOlfb)). the eigenvalue-cluster of 
Pmpc approaches that of P^, and the overlapping area 
of these two clusters increases. When e is increased be- 
yond l/dmax (see Fig. [TOF c) and (d)), some of the eigen- 
values of Pe start escaping the unit circle, making the 
disagreement function diverge, whereas the whole eigen- 
value cluster of Pe -|- Pmpc remains inside the unit cir- 
cle, which ensures its convergence. Moreover, still worth 
mentioning is that the eigenvalue of Pe -I- Pm pc , which 
corresponds to the eigenvector 1, always remains at 1 ir- 
respective of the value of e. This is due to the balanced 
constraints l(34|) imposed on the MFC matrix Q. 

Finally, as shown in Fig.[TOl there are also obvious dif- 
ferences between the all-to-all link and partial link net- 
work cases, i.e. the eigenvalue cluster of the former is 
much smaller and closer to the origin than that of the lat- 
ter. This difference is also attributed to the reduced infor- 
mation fiow imposed by the partial link network topology 
(see Fig. [Tja)). Consequently, the improvements result- 
ing from the use of the MFC prediction mechanism are 
reduced in the partial link network scenario. 



V. CONCLUSION 

In this paper, in order to reveal the role of predic- 
tive mechanisms in many natural bio-groups, we have 
added a certain kind of predictive mechanism to the rou- 
tine consensus protocol to design a novel MFC protocol. 
Furthermore, we have presented mathematical analysis 
as well as statistical simulation results to show the im- 
provement of consensus performances through the use of 
such a protocol. 

In particular, we have compared the routine, FDLA 
and MFC consensus protocols in the general cases of sym- 
metric and asymmetric, balanced all-to-all link networks, 
and asymmetric balanced partial link networks. The 
comparisons have led to the following two conclusions: (i) 
the convergence speed towards consensus can be signifi- 
cantly increased to approach the global optimum via the 
predictive mechanism, namely, even short-term inspec- 
tion of the future can produce a significant increase in 
convergence speed; (ii) the sampHng period range guar- 
anteeing convergence is increased sharply by this predic- 
tive mechanism, giving the MFC protocol the potential 
to effectively save communication energy. These advan- 
tages have been explained through mathematical analysis 
of the eigenvalue distributions. 

To investigate the predictive mechanism more analyt- 
ically, we have provided some necessary and sufficient 
conditions guaranteeing asymptotic convergence towards 
average-consensus for all-to-all link and partial link net- 
works, respectively. In particular, we have considered 
the special case of balanced all-to-all link networks and 
showed that the proposed MFC protocol can effectively 
compress the eigenvalue cluster of the system state ma- 
trix and drive it back towards the origin of the com- 
plex plane when the sampling period is increased beyond 
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the routine convergence threshold. In the special case 
of symmetric all-to-all link networks, we proved that the 
corresponding state matrix Pe + Pmpc shares the same 
eigenvectors as the matrix Pe. 

Furthermore, to verify the generality of these conclu- 
sions, we have also applied the proposed MFC protocol to 
two popular complex network models, the Vicsek model 
[3| and the Attractive/Repulsive model The corre- 
sponding results presented in [l^l show that predictive 
protocol outperforms the routine protocol when taking 
into consideration both the consensus speed and the com- 
munication cost. 

For natural science, the contribution of this work 
lies in its ability to explain why networks of biological 
flocks/swarms/schools such as firefly and deep-sea fish 
groups do not communicate very frequently all along but 
only occasionally during the whole dynamical process. 
From the industrial application point of view, the value 
of this work is two-fold: the consensus speed can be sig- 
nificantly enhanced, and the communication energy or 
cost can be reduced remarkably. All these merits are at 
the cost of giving the agents the capabilities of making 
predictions, which can be efficiently achieved based on 
currently available information. This work is just a first 
attempt aiming at achieving ultrafast-consensus by in- 
jecting a prediction mechanism into classical consensus 
algorithms such as the routine consensus protocol, and 
we hope it will open up new avenues in biological and 
industrial applications. 

Finally, we stress that the presented results rely on 
a centraHzed control approach. In ongoing works, we 
are developping a decentraHzed version of these MFC 
consensus algorithms. 



1. Proof of Theorem]]] 
First, it is easy to see that the matrix Pjj,, m 



has the following structure 

In 



Ptj 



In 

Pe 



P/^" ... 



In 

Pe+lN 



P. 



P. 

+ ... + In 



(41) 

Furthermore, we have 

PxEVi^ AiTyf , . . . , A, "Tyf . 
The weighting matrices Q,R are selected as in (fT3|) . 



Straightforward calculations then show that 

PljEQPxEm = 



Hr, : Hu 



giq" "iXi)rjf,. 



9H, 



(42) 

H^Nxl ' 



where gi q"'""" {X,),..., gn^ ^f^" (A^) denote polyno- 
mial functions of Ai with orders determined by Hp, Hu 
and coefficients determined by q. 

On the other hand, for Hu arbitrary scalars e 
R {i = 1, . . . , Hu), one has Pue [livl , iH^vJ] = 

T 



hi 



H„,Hu 



where hi '""^h^ ,qi^t) ' 



Hp.Hu 
Hj),H^ 



,q{^^)ril 



H^Nxl 

hH^""'"" „ (Ai) are the 
corresponding polynomial functions with orders de- 
termined by Hp, Hu and coefficients determined by 
71, . . . ,7//„ and q. 

Since P^ is symmetric and Q = ql , i? = /, it follows 
that 



{PueQPue + R) [lirif. IH^VI] 



h 



H^Nxl 

(43) 



where fi f^';:^;^^^ (A.) , ■ • ■ , fn^ ^ (A.) are the 

corresponding polynomial functions of Xi with orders de- 
termined by Hp, Hu and coefficients by 71, ... , and 

q- 

For fixed values of Hu, Hp, q and A^, it can be ver- 
ified that gi ^P'^" (Ai) , i — 1, . . . , Hu corresponds to a 
constant scalar denoted by gi, and fi^^^',,,^^ {Xi) , i = 
1, . . . , Hu, corresponds to a linear function of 71, ... , 7^^ 
denoted by /i (71, ... , 7ff„). As a result, the following set 
of Hu linear equations 



/i(7i 



,ihJ = gi, i = 1, . 



, Hu 



(44) 



always possesses a unique solution 71 = 7* , . . . , 7//^ = 
1*H^- With this particular solution, the right-hand sides 
of (02]) and |[43]) are equal, i.e. 

Pi^EQPxEm = {PueQPue + R) K^f , • ■ ■ , Ih^vI] ^ ■ 

Using this last equality, the definition of Pmpc given in 
(fT5)) yields 



PmpcVi ^ - [In,On, ■ 



.0 



N 



NxH^N 



{PueQPue + R) ' 



■PSeQPxe^ 



- [In, On, ■.■,0n] [jIv, 



X 

i , ■ 



Therefore, P^ and Pmpc share the same eigenvector 
■qi, i — I, . . . , N and the corresponding eigenvalue i^i of 
Pmpc equals —jl where 7^ is different for each fixed 
value of Ai. This completes the proof of the property 1) 
in Theorem[I\ 

On the other hand, recall the definition E = 
di&g{e,...,e)H^N(N-i)/2xHpN and take into consid- 
eration that Q — ql. We have E^QE = 
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diag{:i, . . . , 5) with S G 



pNxN 



trix. Then, E^QEPx = 



[hi{P^,^),...,hH^ (P,, where (« 

1, . . . , are polynomial functions of Pe and ^. Due 
to the symmetry of Pe and S, hi{Pe, S) (i = 1, . . . , i/t,) 
are also symmetric. Analogously, P^^QPjje + R ^ 
{tpi,j{Pe)}, ij = where -ipi^jiPe) are poly- 

nomial functions of Pg. Due to the symmetry of P^, 
ipij{Pe), i,j = l,...,Hu are also symmetric, thus 
{PueQPue + contains x symmetric matri- 
ces tpi,]{P() and - [In-, Gn, • • ■ , 0^]^^^^^ {PueQPue + 
P)~^ = - [(^i,i(P<:), . . . ,(^i,//„(Pe)]. Accordingly, it is 

easy to see from (fT5|) that Pmpc — ~Y^f=i^i,i{Pe) • 
hi{Pe,'E,). Since (/5i,i(Pe) and hi{Pe,E) are both symmet- 
ric, one has that Pmpc is also symmetric. This completes 
the proof of the property 2) in Theorem[^ 



being a symmetric ma- and (|45l) gives m = 1 and 71 Ci" = ^ l'^ which implies 

that both 71 and Ci are multiples of 1 . In other words, 
1 is a simple eigenvalue of W and 1 is its associated left 
and also right eigenvectors, i.e. Assumptions Al and A3 
hold. 

Sufficiency: Al and A3 ^ (|22l) . 

\i Al and ^45 hold, then there is a nonsingular matrix 
T such that 



(sp/"^ 



which leads to P^^E^QEPx 



W 



1 
Z 



where Z is a convergent matrix, i.e. p(Z) < 1 (this can 
be derived using the Jordan canonical form [29|). Let 
7i, . . . , 7Ar be the columns of T and , . . . , Cat be the 
rows of T~^. Then, we have 



limfe- 



.00 
= T 



k 



limfe^oo T 

T-i = 71 C: 



1 




1 

z'^ 



T- 



2. Proof of the second part of Lem,m,a[l\ 

Necessity: ([22|) ^ Al and A3 (see [l7|). 
Notice that limi:^oo exists if and only if there is a 
non-singular matrix T such that 



lim W 



lim T 

k — ^00 



Ira 

z 



where Z is a convergent matrix, i.e. p(Z) < 1. One then 
has that 



lim 



k — >oci 



T 



= Urn 

I-m 





A; — >oo 



T 



im 
z*^ 



(45) 



where ji and CT = ^, ■ ■ ■ , N) are columns of T and 
rows of T~^, respectively. Since each is a rank-one 
matrix and J2f=iliCi = TT~^ = In has rank N, the 
matrix lid must have rank m. Comparing l(22|) 



It can be seen from Assumption Al and the Jordan 
canonical form that 71 and Ci can be selected as 
normalized column eigenvector 1-1/ ^fN and row eigen- 
vector 1'^ ■ I/Vn, respectively (note that 71 and (1 are 
not unique, but their product is unique), which implies 
(|22| immediately. 
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